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INTRODUCTION 

Thcs paper attempts to explain why people become 
confused by questions about (be rtlaiion between 
menial ai«1 physical events, When a question leads. 
to confuse, iiioonsLEtenl answers, this may be (1) 
because Ihe question is ultimately meaningless or at 
least unanswerable, but at may also be (2) because 
an adequate answer requires a powerful analytical 
apparatus, My view is that many important ques¬ 
tions aba at the relation betwee n mind, and brain Lire 
of I h is latter kind. ii:n.l that some of the necessary 
technical and conceptual tools are becurning. avail¬ 
able us a result of work on the problems of making 
computer programs behave intelligently. In this 
paper wesujgssl a theory of why inLrospeclion does 
not gi vc clear answers to these questions. The paper 
does not go Mery far Inward finding technical solu¬ 
tions to the questions, but There is probably some 
value in hading nt least a clear explanation of why 
we are confused. 

KNOWLEDGE AND MODELS 

If a creature can-answer a quSttiOrt about a hypo¬ 
thetical experiment. without actually performing 
that experiment, then he has demonstrated some 
knowledge about the world. Fur his answer lo the 
question must be an encoded description of Lbe he- 
Isqvior. inside the creature, of some sub-machine or 
model responding Lo an encoded description of the 
world situation described by the question. 

We use ihe term mode! in 1 his sense' 

J o art vbxrn-er B, an object A * is a model 
nf an abject A to the extent that B ton ate 
A ¥ to answer quest taut that Interest hint 
about A, 


The model relation is inherently ternary. Any 
attempt to suppress the roEc of Ihe intentions of the 
investigator. B. leads to circular definitions or In 
■ambiguities about essential features and the I ihe. 
It is understood ihftL fi's use of a model emails the 
i.m: of encodings for input and output, both Tor A 
and for A*. If A is ihe world, questions Tor A are 
experiments- A' is agrrad model of A. Ln B’s vtew. 
to the extern that A‘‘i Answers agree with A's, On 
the whole, over Lhijse questions irppormnt lo b 

When a man M answers questions about the 
world, then (taking on ourselves the role of Bi we 
attribute this ability to some internal mechanism. 
W-, inside of M. It would be most convenient if 
we COuld discern physically within M two separate 
r-vj ion s W T and M-W* >uch tha-i W* really contains 
the iiftwnjedj[e and M-W* contains only general- 
purpose machinery for coding questions, decoding 
answers, and general administrative work. How¬ 
ever, one cannot really expect Lo find., in an intelli¬ 
gent machine. a clear separation b«w«rt coding 
and knowledge structures, either anatomically or 
lur.ctianally,because (lor example) some knowledge 
is likely to be used In ihe encoding and interpreting 
processes. For our purposes what is important is 
the intuitive luiilon of a model, not the technical 
abiliLy to delineate a model's boundaries. Indeed 
part of our argument hinges on the inherent diffi¬ 
culty uPdi'ci;rnmg such boundaries. 

MODELS OF MODELS 

QuestLqns about ihmgs in the world are answered 
hy making statements abouL properties of corre- 
spcncltng structure?!, in une's model W* of the 
world For simple mechanical, physical or geo- 
rmfirk mutters one can imagine, as did Craik. : 
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machinery that docs symbolic ealculilLion but— 
when Tend through proper codings—has an ap¬ 
parently analog charadcr. BuL wbal a haul 
broader questions about the nature of the world? 
Tiiesc have [o be Lrcaicit (by Si) not as questions lo 
be answered ?u ft r *, but as questions lo be answered 
by making general statements about ft'* Ef W x 
contains a model M* of M, then W** may contain 
a model M ** of M*. Indeed, (bis muil be the case 
if M is do answer gener;jl questions about himself. 
Ordinary questions shout himself, eg , how tall is 
he, are answered by VI*, but very broad quest ions 
about hii nature—what kind of a thing is [it, ele„ 
are answered, if al all, by descriptive- statements 
made by M ** aboui M 4 

The reader may be anxious, at this point, for more 
details about the relation between W* and ft** 
How can he lell. for example, when a question. Is 
of the kind (has requires reference to W 1 ’ rather 
than to ft"*. Is ft'** a part of ft'*? {Certainly ft'*, 
like everything else, is part of ft 1 .) Urifon iLnarely, 
ItuhiiOl supply these dct-nils yet, and expect serious 
problems in eventually clarifying them-. E think we 
must envision W** as ifrdtiding an interpretative 
mechanism tbas can make reference to ft'* using 
it uS a sent of computer-program subroutine—to a 
WHaid depth of recursion. In this sense ft ,J * 4 must 
contain ft'*, bul in Another more straightforward 
sense W* can contain ft'**, This s-uggesls (I) that 
the notion contained Sti is not sufficiently wphkli- 
CuLed to describe the kinds of relations between 
parts of program-bkc processes and (2) the intuitive 
notion of model usud herein is Likewise too unso¬ 
phisticated to support developing! he theory in tech¬ 
nical detail. It is clear that in this area one cannot 
describe mftnnodcl relat ion ships in terms of models 
as simple physical Substructures. An adequate 
analysis will need much more advanced ideas aboul 
symbolic representation -nT information processing 
structures. 

DIMORPHISM Of OUR WO'RLDAIODELS 

A man’s model of the world has a distinctly bi¬ 
partite structure. One pan is concerned with mat¬ 
ters of mechanical, geometrical, physical character. 
The other pari is associated with shiags like gouts, 
meanings, social matters and the Tike. This division 
of ft'* carries through (he representations of many 
things-in ft *, especially to M itself.. Hence a man's 
model of himself is distinctly bipartite, one part 
concerning his body as a physical object, the other 
accounting for his social and psychological experb 
ence. ft'Jicn we sec an object we account for its 


mechanical support and coherence {we are amazed 
at levitations) and we also accounL, in dilTcrenl 
terms, for its teleology — why put it there for what 
purpose, ft hen something moves we find either a 
Simple force or a purpose—rarely both—in ordi¬ 
nary common-sense explanation; the kind that eon- 
oerns US litre. 

Why this division, so richly represented in lan¬ 
guage and thought'? ft'e recognize that a person's 
W* is not really two dearly disjoint pares bul mast 
have many overlapping, indistinctly-bounded mod¬ 
els, The bipartite structure proposed here as Only 
an appro* i million and we do not really want u> sug¬ 
gest that the argument depends at nil on a clear 
division into any partieu\#r number of parts. 

The distinction between lingerie explanations 
and informational {or symbolic) explanations js 
another aspecL of the same general dimorphism 
In one sphere, mechanical-geometric constraints are 
powerful— impenetrability in Lb; arrangement of 
physical objects, conservation in (heir transforma¬ 
tion. Tot instance. In the oilier sphere, one liradi 
symbolic constraints of (substantially) equal power. 
The rwu domains overlap in many complicated ways 
—a child discovers nwchartici] obstacles, c.g., in the 
forms of Limitution of reach, mobility, strength, and 
precision, Lo its psychological goals; it discovers 
emotional symbols in the geomcLrlc arrangements 
of facial expressions and intentions, in post oral 
attitudes. In explanations of complicated Lhings the 
lwy models become inextricably involved, wc., the 
imagery of the above sentences. Uut this tnvolve- 
mejLt reflects not so much any syndesis of the two 
kinds of explanation, ! am afraid, as it reflects the 
poverty of either model for description of compli¬ 
cated situation. 

As for t he genesis of such partitions, r am inclined 
to suppose ih:it lhey grow apart rather than to¬ 
gether, on rhe whole, That is not Lo say Lhat infan- 
Lik, primitive models are more unitary, but Lhat 
they art simply Loo indistinct to admit approximate 
boundaries. An infant is not a mortise: it simply 
hasn't enough structure in M** to- he a dualist yet; 
it can hardly be sard to have a position on the miad- 
body problem. 

THE CENTRAL ARGUMENT: RELIEF IN 
DUALISM 

ft hen ,i man is asked a general question about his 
Own nalure, he tries to give u general descripiion of 
bis model of himself. Thar is, ihe question will he 
answered by M To the exrent :bai {]) M " 15. 
divided as we have supposed and (2) lhat the man 



has discovered ihis that is, this fad i4 repreSemed 
in M**, Isis rcf>ly will show ibis. 

His statement this hrlirf I that he has a mind 

as welt as a body is the etmvertiiortal way (v 
express the roughly bipartite appearance of 
his mode! of himself. 

Because the separation of (be iwd parts of VI* is 
so indistinct, and their interconnections are so com¬ 
plicated and difficult to describe, I he man'* further 
attempts (0 elaborate on Ihe nat aft of this mind- 
body distinction arc bound to be confused and un¬ 
satisfactory. 

A condensed version of Ibis argument was pre¬ 
sented in Minsky. 1 

HEURISTIC VALUE 01 (JUASI-SEI'AH ATE 
MODELS 

l‘'rom a scienltfk point of view, it is desirable to 
obtain a unitary model of ihe world comprising 
both mecltanical and psychological phenomena. 
Such a theory would become available* for example, 
if" the workers in Artificial Ente! licence, Cybernetics 
and Neurophysiology ell reach their goals. Still, 
such a success might hare lit lie elftcr on Lhc overall 
form of our personal world-models. E will maintain 
thin for practical, heuristic reasons, these would 
Mill retain their form of quasi-separate parts, liven 
when a discipline is grossly transformed in tech¬ 
niques. bares, and concepts* it Can maintain its iden¬ 
tity if its problems and concerns remain grouped 
together for practical reasons For example, Chem¬ 
istry survives Inday as a science because Ihe primi¬ 
tives of the quantum theory area lt(Lie too remote 
for direct application iu practical problems; a hier¬ 
archy of intermediate on norms arc necessary to 
apply the theory io everyday problems. The primi¬ 
tive notions of physics, or even of neurophysiology, 
will be far too remote lu be useful in accounting. 
directly, for the men Lai event* of everyday life. 

Thus synthesis by direct theoretical reduction is 
unlikely to have a large efFcct on the overall form of 
W*. The heuristic need for appros i matcl y self- 
coDrained subrheorLes is too Strong to resist, in prac¬ 
tical life and though I Now one might hop^ for 
another kind of unity—parallel rather than liier- 
archical—in which the quasi-separate models are 
converted to basically similar structures and then 
merged by removal of redundancy, with cod inn for 
those differences that remain significant, !l is 
doubtful that much can be don-e in ihis direction. 
The use of psychological explanations for physical 
processes runs exactly counter to the directions that 


have led Lb scientific progress. Similarly, there have 
long been available plenty of reductions of psycho¬ 
logical ex.pl anal ions to analogies with simple physi¬ 
cal systems, hut these arc recognized as inadequate 
and are giving way to in forma! ion-processing mod¬ 
els of more abstract character, 

In everyday practical Lhought physical analogy 
metaphors play a large role, presumably because 
one gets -ii large piiyolf for a model of apparently 
small complexity. (Actually., the incremental com¬ 
plexity is small because the mode! is already there 
a$ part oT the physical part of W*T It would be 
hard to. give up such metaphors, even though they 
probably interfere wish our further development, 
just because of this apparenL high value-Lo-cost 
ratio. We cannot expect to get much more by ex¬ 
tending the mechanical analogies, because they are 
so informational in character. Menial processes 
rescmhle more Ihe kinds of processes found in com¬ 
pute: programs—arbitrary symbol-associations, 
tree-like storage schemes, conditional transfers and 
the like. In short, wt can expect the simpler useful 
mechanical analogies to survive, but LL seems doubt¬ 
ful Lhat they can grow to bring us usable ideas for 
the parallel unification uf W*. 

Finally we should note that in a creature with 
high intelligence one can expect to fmd a well devel¬ 
oped special model concerned with the creature's 
own problem-solving activity. In my view the key 
to any really advanced problem-solving technique 
must exploit some mechanism for planning—for 
breaking the problem into parts ami allocating 
shrewdly the machine's a (For l and resources for the 
work ahead. This means the machine must have 
facilities for represen ling and analyzing its own 
goals aed resources, One could hardly expect to 
find a useful way to merge this structure with that 
used for analyzing uncomplicated structures ?n the 
outer world--nor could one expect that anything; 
much simpler would he of much power in analyzing 
the behavior of oilier creatures of the same char¬ 
acter. 

I NT EJi I 1 It TTF.fi.S 

The nolion ofpurr is more complicated Tor things 
like comparer programs than for ordinary physical 
objects. A single conditional bra itch intakes it pos¬ 
sible for a program to behave, functionally,, like 
Lwo very dllTcreni machines tin different circum¬ 
stances, yet using almost (or exactly) the same sets 
of instructions. 

The notion of a machine containing a model of 
itself is also complicated, amj one might suspect 
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potential logical paradoxes. Tlitre Li no logical 
problem ahoutihe basic Idea, Tor the internal model 
could be very much simplified, and its internal 
model could be vacuous, But. in fact, there- is nd 
pa radon even in a machine's Having a model L>f iixelf 
complete tn ati detail! For example, it is possible 
td construct a Turing machine shat can print out an 
entire description of itself, and also execute an arbi¬ 
trarily complicated computation, so that the mi- 
ehrne is net expend-snft all iti structure on its de* 
Scjiplion, I ci particular, the machine can con Lain 
an irutrytsMufri' program which tan use the internal 
description to calculate what the machine would do 
under some hypothetical circumstance. Similarly, 
white it is impossible for a machine or mind to 
analyse, from moment to moment precisely what it 
is doing at each step (for it would never get past 
the first step) there seems to he no logical limitation 
to the possibility of a machine underetarding ns 
own basic principles of operation or, given enough 
memory, examining all Lhe details of its operation in 
some previously recorded state. 

With interpretative operation ability, a program 
can use itself as its own model, find this can bo 
repealed recursively Id as many LeveLs os desired, 
UlitII ihe memory recoils of the stale oT (he process 
gel out of hand. With the possibility of this sort 
of introspection* the boundaries butwe^n part-t. 
things and ntwldi hecOme very hare| to understand. 

Poes iarerpreied operation play an important 
role in our menLa] function'? Il if clear that one 
interprets memOTiMd insCruCLions, in certain cir¬ 
cumstances. One could memorize, for example, the 
rules for reading musical notation and I hen usually 
perform 4 piece of music — fit fi very slow tempo 
by referring to these rules in executing each note. 
Eventually, with practice, one plays Taster and it 
seems clear that one is no longer interpreting the 
rules for each note, but that one has assembled 
special mechanisms for the lask. This certainty 
Suggests tin analogy with the notion of (ompilrng 
a previously interpreted program. Perhaps our Level 
of consciousness is dowdy related to the extern to 
which the machine is functioning tnlcrp relatively 
rather than executing compiled programs. While 
interpreting, one has Ltic opportunity of examining 
she tiexl step in the task before doing it. 

FRF.E WILT 

If one thoroughly understands a machine or a 
program one finds no urge to attribute voiftion U> it. 
If one does not understand it so well, one must 
supply an incomplete model for explanation. Our 


everyday intuitive models of higher human activity — 
are quite incomplete and many notions in our In¬ 
formal diplumitioitedo not tolerate close examina¬ 
tion, Free-will or volition is one such motion— 
people are incapable of explaining how it differs 
from stochastic caprice, but feel strongly (hat it 
does. I conjecture that Shis idea has its genesis In a 
strong primitive defense mechanism. Briefly, in 
cbiLdbond we Learn to recognize various forms of 
aggression and compulsion, and to dislike them, 
whether wc submit or resist, OtdcT, when told that 
our behavior is corn rolled by iwh-and.such a set 
of laws, we insert Lhii fact in ou.r mode] {inappro¬ 
priately) along with other recognizers of compul¬ 
sion, We resist compulsion no matter from whom. 
Although resistance Is logically fulile the- resentment 
persists and is rationalized by defective explana¬ 
tions, since the alternative is emotionally urtficcepi- 
able. 

How- is this reflected in IVt T *? ]f one asks how 
one’s mind works, one notices aieas where Lt is 
(perhaps incorrectly} understood — that is. where 
one recognizes rules, One sees Other areas where 
one looks rules. One can fill [Ins in by postulating 
chance or random activity. Bet this too, by another 
route, exposes the self to the indignity of remote 
control. We resolve this unpleasant form of M“ 
by postulating a third pfirt—embodying 4 will or 
spirit or conscious agent, Hue there is no structure 
in this part; one can say nothing meaningfuL about 
Lt. This is because whenever a regularity Is ob¬ 
served, sts reprcwn Kit ion- is transferred to the dels re¬ 
in irtfistic rule region The will-model is thus uot 
formed so much from a need for a place to store 
definite information about one's self, it has the sin¬ 
gular character of being forced into the model, 
willy-nilly, by formal but essentially content-free 
ideas of what Ihe mode! m-usl contain. 

CONCLUSION 

When intelligent machines ;itb cnujifnoted, we 
should not he surprised 10 find them as confused 
and as stubborn as nten on their convictions about 
mind-matter, consciousness, free will and the like. 
For all such questions are pointed fit explaining 
(he complicated interactions between parts of the 
self-model. A man's or a machine’s strength of 
conviction about such things tcMs us nolhing about 
the world. Or about the man, except for what it 
icits as abou t his model of himself 

The gross divisions o-f our models probably have 
much heuristic value to us. Indeed we identify (In 
children) some stages in delmealing the distinction^ 
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be? ween (hew models us associated with growlh oF 
intelligence. The distinctions could ho abandoned 
only at great coat—in everyday practice. That is 
why, even if one accepts ihe conclusions of this 
essay, he is unlikely to note any serious effect on 
his way of thinking about most things. 

i am indebted to 5. Paper! for several ideas in 
this essay. 
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